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Abstract 



In this work, we prove several relations between three different energy minimization techniques. A recently proposed 
methods for determining a provably optimal partial assignment of variables by Ivan Kovtun (IK), the linear 
programming relaxation approach (LP) and the popular expansion move algorithm by Yuri Boykov. We propose 
a novel sufficient condition of optimal partial assignment, which is based on LP relaxation and called LP-autarky. 
We show that methods of Kovtun, which build auxiliary submodular problems, fulfill this sufficient condition. The 
following link is thus established: LP relaxation cannot be tightened by IK. For non-submodular problems this 
is a non-trivial result. In the case of two labels, LP relaxation provides optimal partial assignment, known as 
persistency, which, as we show, dominates IK. Relating IK with expansion move, we show that the set of fixed 
points of expansion move with any "truncation" rule for the initial problem and the problem restricted by one-vs-all 
method of IK would coincide - i.e. expansion move cannot be improved by this method. In the case of two labels, 
expansion move with a particular truncation rule coincide with onc-vs-all method. 



Keywords: energy minimization, partial optimality, persistency, max-sum, WCSP, MRF, autarky, LP-relaxation, 
expansion move. 



1 Introduction 

1.1 Energy Minimization 

In this wort ^ we consider minimization problem of the 
following form: 



mm 



s6V 



stG£ 



minf(a:). (1) 



^The work was supported bu EU projects FP7-ICT-247870 
NIFTi and FP7-ICT-247525 HUMAVIPS and the Czech project 
1M0567 CAK. 



Here, V is a finite set and £ C V x V. A concate- 
nated vector of all variables x = {xs\s ^ V) is called 
a labeling. Variable Xs takes its values in a discrete 
domain Cs, called labels. Labeling x takes values in 
C, the Cartesian product of all domains Cg. In this 
paper all Cg will have the same number of labels, but 
may have different associated orderings, etc. Notation 
st denotes the ordered pair (s, t) and Xst denotes the 
pair of corresponding variables, {xs,Xt). The objective 
is composed of term /o £ M and functions fs : £s — !• M 
and fst : Cs X Ct R. 

The problem (1) is considered in several fields. It 
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is also known as the labeling problem, the Weighted 
Constraint Satisfaction (WCSP) and for the case of 
two labels (|Ls| = 2,Vs) as the pseudo-Boolean^ opti- 
mization [1]. Our terminology comes from considering 
probabilistic models in the form of Gibbs distribution. 
There is certain difference between problems with two 
labels and more than two labels, the later will be re- 
ferred to as multi-label problems. 

1.2 Partial Optimality 

Energy minimization ( 1 ) is an NP-hard problem in gen- 
eral. Techniques which allow us to find a "part of the 
optimal" labeling arc of our central interest here. The 
idea is that it may be possible to fix a part of variables 
to take certain labels such that any optimal labeling 
will provably have the same partial assignment. 

More precisely, we consider a subset of variables A C 
V and the assignment of labels over this subset y = 
(jjs \ s Q A). The pair {A, y) is called a strong optimal 
partial assignment (strong persistency [3]), if for any 
minimizer x* it holds = y, where notation x\ is the 
restriction of to^l, i.e. {x* \ s G A). Likewise, if there 
exist at least one minimizer x* , for which = y holds 
we say that [A, y) is a weak optimal partial assignment. 

Two or more strong optimal partial assignments can 
be combined together, because each of them preserves 
all optimal solutions. This is not true for weak assign- 
ments, even if they assign different variables, - they 
may not share any globally optimal solutions in com- 
mon. However, if we want to find a minimizer of (1) 
(or at least "localize" it as much as possible), a weak 
optimal partial assignment could be more helpful - the 
best one assigns all variables. 

1.3 Domain Constraints 

The idea of optimal partial assignment naturally ex- 
tends to constraining a variable to a subset of labels 
Ks C Cs- Let ^ C V, let Ks C C^, Vs e A. Let K be 
the Cartesian product of Kg, s G A. We say that a pair 
{A, K) is a strong (resp. weak) optimal constraint if 

^Variables Xa £ {0, 1} are regarded as Boolean in this case 
and "pseudo" emphasize that a real-valued rather than Boolean 
function of these variables is considered. 



x\ G K for all (resp. at least one) minimizer x*. This 
type of constraints is called domain constraints. Obvi- 
ously, it includes partial assignment as a special case. 

1.4 Autarkies 

Some domain constraints follow from more specific 
properties called "autarkies" . This term occurs in [3] 
for two-label problems and we consider its exten- 
sion [TS] to multi-label problems. 

Let £s = {0, 1 . . . L} Vs e V, L e N. Let x,y e C. 
Define component- wise minimum and maximum of two 
labellings: 

{x A y)s = m-m{xs,ys), (2a) 
(x V y)s = niax{xs,ys)- (2b) 

A pair (a;™'" e £,a;"^^'' G £) such that x'"'" < x'"^'^ 
(component-wise) is called a weak autarky for prob- 
lem (1), if 

Vx e £ {{{x V x""") A x"'^'') < f (x). (3) 

If additionally for any x {x \/ a;™'") A x™^^ strict 
inequality 

f ((x V x""") A x'""") < f (x) (4) 

holds, then the autarky is called strong. 

The autarky provides domain constraints with Ks = 
[x""", . . . ,x™'''^]. For any minimizer x*, we have that 
X — (x* V X™'") A x'^^^^ is a minimizer as well, and 
is G Ks. A strong autarky guarantees additionally 
that X* must itself satisfy x* G Ks. Indeed, if it was 
not true then x ^ x* and f(x) < f(x*), which is a 
contradiction. Therefore a weak (resp. strong) autarky 
provides a weak (resp. strong) domain constraint. 

Determining whether a given pair (x™'", x™'''') is a 
strong autarky is an NP-hard decision problem [3]. 

Autarkies can be combined together. A join of two 
autarkies (x"'^, x^), {y^, y'^) is the pair (x-'^ V y^, x^ A y'^). 
For strong autarkies, the result is a strong autarky and 
this operation is commutative, associative and idem- 
potent, so that it defines a semi-lattice. 

Proof. From definition of autarkies, we have 
f((((xVxi)Ax2)Vyi)Ay^) < i{{x\Jx^)hx^) < f(x) (5) 
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Note, that for < we have {x V x^) A .t^ = (a; A 
x^) V x^. We can rewrite the labehng in the left hand 
side (LHS) as fohows 

{{xV x^) A x'^)Vy^) Ay^ = 
{{x A x^) V {x^ \/ y^)) A = (6) 
{xA (x^ Ay^)) V {x^ Vy^), 

where doted cquahty holds if > x^. This is satisfied 
for strong autarkies, because it would be a contradic- 
tion that all optimal labellings arc below y^ and above 
x\ □ 

Thus there exists an autarky, which provides the 
maximal amount of domain constraints among strong 
autarkies. It is the join of all strong autarkies. 

It is also possible to join "non-contradictive" weak 
autarkies together, but let us leave it aside for now. 

We will consider a special cases of autarkies 
with "one-side constraints", of the form (a;™'",L) or 
{OjX'^^'^), where L and represent the labeling with 
all components equal to L (resp. 0). For such au- 
tarkies inequality (3) simplifies, because xW ~ x and 
X A L = X. Methods [TO] E] compute strong autarkies 
of this form. By taking the join of two strong au- 
tarkies (x""",L) and (0,a;™^'') we can obtain a strong 
autarky {x"^^'^ , x™^^) . However, the reverse is not true: 
if (a::™'",x™^'') is a strong autarky, it does not imply 
that or {0,x"''^^) is an autarky. And it is the 

case that other methods (roof-dual [T] in the case of 
two-label problem and its multi-label extension [TS]) 
can find an autarky of the form (x™'", x"'^^^), which is 
not a join of two one-side autarkies. 

1.5 Submodular Problems 

Function f is called submodular if 

Vx,ye£ f(xVy) + f(xAy) <f(x) + f(y). (7) 

In the case f is defined by (1), it is submodular iff (see 
e.g. [H]) Vst e £, Wxst,yst € ^st ^ Cs 'x C-t 

fst{Xst) + fstiyst) > .fst{Xst Ayst) + fstiXst''^ yst)- (8) 

Minimizing a pairwise submodular function reduces to 
MINCUT problem [7], [l3]. Let f be submodular and x* 



be its minimizer. Then we have the following proper- 
ties: 

f(x Vx*) < f(x), (9a) 
f(x Ax*) < f(x). (9b) 

They easily follow from submodularity, noting that 
f(xVx*) > f(x*) andf(xVx*) > f(x*). So, in fact, any 
pair of optimal solutions (x^*,x^*) is a weak autarky 
for this problem. Moreover, if we let 

x""" = A argminf(x), (10a) 
^max ^ y argmm f (x), (10b) 

where argmin is the set of minimizers, we see that both 
X™™ and x™^^ are minimizers of f and that (x™'°, x™'^'') 
is a strong autarky for f. In fact, it is the join of 
all strong autarkies for f. This strong autarky can 
be determined from a solution of the corresponding 
MAXFLOW problem. 

2 Approach by Kovtun 

In this section, we review techniques [TOl E] for build- 
ing autarkies (and hence domain constrains) by con- 
structing auxiliary problems. We take a somewhat dif- 
ferent perspective on these results, however, our state- 
ments and proofs here are in a sense equivalent to ones 
given in [TUl [TT] . 

Theorem 1. Let i = g + h, let (x""'", x"^'''') be a 
strong autarky for g and a weak autarky for h. Then 
(x™'",x™^'') is a strong autarky for f. 

Proof. We have 

f((x Vx""") Ax'"^'^) = 

g((x V X™") A x"^^'^) + h((x V X™") A x"^^'^) < (11) 
g(x) H-h(x), 

and the inequality is strict if (x™'", x"'^^^) is strong for 
either h or g. □ 

The idea of auxiliary problems is to construct a sub- 
modular g, for which, as we know, a strong autarky 
(x™'",L) can be found by choosing x""" as the lowest 
minimizer of g, given by (10a). The trick is to find 
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such g that {x™™,L) is at the same time an autarky 
for h = f — g. The fohowiug sufScient conditions were 
proposed [TT]: 



Statement 1. Let h satisfy 

hs{Xs V Xs) < hs{Xs) 

Vst e £, Xst e Cst, Xst e K^t 

hstiXst V Xst) < hstixst)- 



(12a) 
(12b) 



Then for any x""" such that x™™ G Ks, the pair 
(x™™,i) is a weak autarky for h. // additionally 



Vs G V, Xs G Ks, Xs < Xs 

hs{Xs V Xs) < hs{Xs), 

then (x""",L) is a strong autarky. 



(12c) 



Proof. For any x G C, summing corresponding inequal- 
ities from (12a) and (12b), we obtain 



^ hsixs V ") + ^ /i,i(x,t V z"") < 



Y,hs{xs)+Y.hst{ 



(13) 



If a; V a;"'" 7^ x, then 3s G V Xs < xf"' and (12c) 
imphcs strict incquahty. □ 

Two practical methods were proposed pT] to con- 
struct g and {Ks | s G V) . Wc first describe a more 
general approach. 

Algorithm 1: 
Sequential construction of g, {Ks \ s G V), Ul^ 

1. Start with Ks = 0, s G V; 

2. Find g such that h = f — g satisfies (12) and g 
satisfies submodularity constraints (8 ) . 

3. Find x™'" = f\ argmin^; g{x); 

4. If xf" G Ks for all s G V then stop. 

5. Set Ks^KsU {x^""} Vs G V and go to step 2. 

In step 2 for each edge st & £ a system of linear 
inequalities in gst has to be solved. While [11] provides 
an explicit solution, for our consideration it will not be 
necessary. When the algorithm stops, g is submodular 



and (.T™™, L) is a strong autarky for g and a weak 
autarky for f — g. By Theorem 1, it is a strong autarky 
for f. It may stop, however, with x™'" = for all s, 
so that efficiently no constraints are derived. Being 
a polynomial algorithm it cannot have a guarantee to 
simplify the problem (1). 

A simpler non-iterative method proposed in |10j is 
shown in Algorithm 2, It attempts to identify nodes s 
where the label L is better than any other label. The 
constructed auxiliary problem g has a property that 
its lowest minimizcr a;""" = /\ argming(a;) is guar- 

Algorithra 2: One vs all method, fTU. flT) / 

1. For each s chose such ordering of Cs that G 
argmin fs{i). 

2. Set gs = s G V. 

3. Set Ks = {0,L}. 

ast, i^ L, j ^ L, 

bst, i = L, j ^ L, 

Cst, ii^L, j ^ L, 

dst, i 7^ j ^ L, 
where a^t, hst, Cst, dst SuTC such that fst ~ gst satisfy 
(12b) and submodularity constraints. One of the 
solutions is as follows: 

a-st = fst{L, L), 



4. Set gst{i,j) = < 



(14) 



bst = min fst{L,j), 
Cst = nnn/st(i,L), 

dst ^ mini bst + Cst ~ast, min fst{hj) 
-|-min{5st - fst{L,j),Cst - fst{i,L)] ) 



anteed to satisfy .t™™ G Ks Vs G V. (because all 
costs {gst{hj) \ i < L, j < L) are equal and gs{0) < 
gs{i) Vs G V,Vi < L, see proof in [IH])- Therefore 
(a;""", L) is a weak autarky for f — g and Theorem ( 1 ) 
applies. 

Both methods allow us to choose various orderings 
of sets Cs- Strong domain constraints derived from 
various orderings can be then combined. 
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3 LP- autarkies 



/i A y G A is constructed as: 



In this section we introduce a special subclass of au- 
tarkies, which preserve optimal solutions of the LP- 
relaxation. Unlike with general autarkies, the mem- 
bership to this subclass is polynomially verifiable. We 
show that autarkies constructed by algorithms 1 , 2 be- 
long to this subclass. This has useful implications for 
LP relaxation. 

3.1 LP Relaxation 

Let be a vector with components 4>{x)q = 1, 

4>ix)s,i = lxs=ij and 4'{x)stsj = lxst=ijj, where is 
1 if the expression inside is true and otherwise. Let 
/ denote a vector with components /o, fs,i = /s(*) and 
fst,ij = fst{ii)- With respect to components of energy 
functions we will be using this index and parenthesis 
notations completely interchangeably. Let (•, •) denote 
a scalar product. Then we can write energy minimiza- 
tion as 

min(/,0(a;)). (15) 



Its relaxation to a linear program is written as 
> min(/, jj), 



(16) 



where A is the local polytope. It approximates 
conv{0(a;) | x G C} from the outside, see e.g. [T^ for 
more detail. It is given by the linear constraints 

A'o = 1, 

lJ-s,i > 0, UstAj > 0, 

J2 l^st,ij = 1 Vst G £, 
ij&Cst (17) 

l^st.i] = Ms.i Vi G £s, si G £, 
J2 l^st.ij = /^tj G Ct, st G £. 

Vector /i G A is called a relaxed labeling. 



3.2 LP-autarky 

We now extend the notion of autarky to relaxed la- 
bellings. 

Definition 1. A binary operation A: A x C ^ A, is 
defined as follows. Let y G C and fi E A. Then v = 




l^st,ij •} 

i'>ys 
j'>yt 

i'>ys 
j'>yt 

0, 



i < Vs, 
i = Vs, 

i > Vs] 

i < ys,j < yt, 
i = ys,j < yt, 

* < ys,j = yt, 

* = ys,j = yt, 

i> ys or j > yt. 



(18a) 



(18b) 



By construction, the relaxed labeling i> has non-zero 
weights only for labels "below" y: Vs.i — for i > ys 
and the same for pairs st, ij. Let us check that G A. 

Proof. Normalization constraint: 
Marginalization constraint: 



st,ij 



E Mst/y + E i^sta'j, j < yt, 

i<ys i'>ys 

E iJ-st,ij + E A^st.i'j', 3 = yt, 

i<ys i'>ys 

]">Vt f>yt 

0, j > yt. 



Vt, 



(20) 
□ 



Operation v — ^)Ly is defined completely similarly, 
having singleton components 



{i^^-y)s 





« > ys. 


E f^s,i'. 


i = ys. 


i'<VB 




0, 


i < ys- 


say that a 


pair (a;""" 



(21) 



weak LP-autarky for f , if 

Vm G A (/, i^l A x""") y a:'^--) < (/, (22) 

If additionally for all fi such that (/i A x""") Y x"^"^"^ ^ /i 
the strict inequality holds then we say that it is a strong 
LP-autarky. 
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3.3 Properties of LP-autarkies 

Statement 2. Any weak (resp. strong) LP-autarky is 
a weak (resp. strong) autarky. 



Proof. By substituting fi = 4){x). 



□ 



Statement 3. Checking whether (x'"™, x''^'^^^) is an 
LP-autarky for f can be solved in a polynomial time. 

Proof. By construction, {fi A a;™'") Y. x™'^'^ is a linear 
map in /x, let us denote it Afi. Inequality (22) holds iff 



(23) 



which is a linear program. To verify whether A is a 
strong LP-autarky we need to solve 



min(/, fi — Afi) > 
^ e A, 

^ E E M.,. <|V| 



Statement 4. // f is suhmodular, then 

V/i e A, Vy e £ 



(24) 



□ 



(25) 



Proof. Scalar products in ( 25 ) are composed of sums of 
singleton terms and pairwise terms. We first show that 
sums of singleton terms are equal, expanding singleton 
terms in the right hand side (RHS): 

[{f^^y)sa + {fJ.Yy)s,.]fs{i) = 

s i 

s i<ys s i' >ys 

Y Y + 5Z X] >^=yf'iy=) = (26) 

s i>ys s i' <yg 

YY'^^'^f"^'^'! '^Y = 

si si' 

YY^'Mi) + YYl'= ys}Mys)- 

si si 

Now consider submodularity constraints: 



\/st e £,\/ij e Cst,yyst e jC-st 

fstiij) + fstiVst) > fstiij A yst) + fstiij V y^t)- 



(27) 



Multiplying this inequality by /ist.y and summing over 
ij, we obtain on the LHS: 



Y l^st,ijfst{ij) + fstijjst) = 
ij 

ij ij 

and on the RHS: 

ij 

where the equality is verified as follows: 

ij 

Y l^st,tj fstiij) + Y Mst,!j7st(ys, j) + 



(28) 



(29) 



i<Vs 

j<yt 



i>ys 
j<yt 



Y i^st,ijfstii,yt) + Y 

fstiVs 



(30) 



i<ys 
j>yt 



i>Vs 

j>yt 



Styij- 



The term with M is rewritten similarly. By summing 
inequalities (28) > (29) over st € £ and adding equal- 
ities (26) of the singleton terms, we get the result. □ 

Statement 5. Let f be suhmodular and x* G 
arg min f {x) . Then G A 



(/i AX*,/) < (Ai,/), 

{fiYx*J) < if, J). 



(31a) 
(31b) 



Proof. Let us show (31a). For suhmodular problems 
LP-relaxation (16) is tight. Thus for any S A there 
holds {iy,f) > f(.T*) = {(f){x*),f). In particular, for 
= fi Ay wc have (fi A y, f) > ((/)(a;*), /), which when 
combined with (25) implies the statement. □ 

Statement 6. Let (x""",L) be a strong LP-autarky 
for f , then: 

Vs e V, < xf", Vm* e argmin(Ai, /) /x* , = 0. 

(32) 

Proof. Let fi* G arg min^gA(/^, /) and ^* j > 0. Then 
H* y x""'^ ^ /i* and y x""") < f (/x*), which con- 
tradicts optimality of fi*. □ 
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3.4 Implications for Algorithms 1,2 

We have already seen in statement 5 that for a sub- 
modular problem g, taking ?/ as a minimizer (resp. the 
lowest minimizer) of g gives a weak (resp. strong) LP- 
autarky {y,L). Let us show that statement 1 extends 
to LP-autarkies too. This would imply that autarkies 
derived by algorithms 1 , 2 are in fact LP-autarkies for 
f = g + h. 

Statement 7. Let h satisfy inequalities (12). Then 
for any y £ C such that y^ G Kg, the pair {y,L) is a 
weak LP-autarky for h. 

Proof. Let /i G A. From inequality (12a) we have 

^^((//yj^)^^^-^^^^)/!^^^ <0. (33) 

s i 

Multiplying (12b) by ^st,ij and summing over ij G Cst 
and over st G £ we obtain 

XI 5Z - 2^)''*'^ ~ Mst,»j] hst,ij < 0. (34) 

St ij 

Adding (33) and (34), we get: 

{^lYy^f,,h) <0, (35) 
which is equivalent to (22). □ 

We have shown that algorithms 1 , 2 derive do- 
main constraints in the form of strong LP-autarkies. 
We know too that optimal solutions of LP-relaxation 
will obey domain constraints derived via strong LP- 
autarkies. Note, while algorithms 1 , 2 depend on the 
ordering of the labels, solutions of the LP-relaxation 
does not. Hence, 

Corollary 1. Let [L'Cs C -C^ | s G V) he a strong domain 
constraint derived by Algorithms 1, 2 w.r.t. any order- 
ing of sets Cs ■ Then the set of optimal solutions of LP 
relaxation with and without these domain constraints 
would coincide. 

We proved that LP relaxation cannot be tightened 
by algorithms 1,2, It may only be simplified by elim- 
inating all variables which are guaranteed to be in 
every optimal solution. This may be useful in practical 
methods solving LP relaxation. 



For problems with two labels, the following relation 
also holds. Let A* = argminpgA(/, m)- Let 

XT'" = minii I 3^* G A* , > 0}, 

' (36) 
XT'" = max{i I 3^* G A* > 0}, 

then (a;™'", x™''^) is a strong autarky for f. This is 
the roof-dual autarky [l]. Because for any other au- 
tarky derived via algorithms 1 and 2 statement 6 holds, 
we conclude that roof-dual autarky dominates algo- 
rithms 1 and 2, 

4 Expansion Move 

Expansion move algorithm [3] seeks to improve the cur- 
rent solution X by considering a move, which for every 
s G V either keeps the current label Xs or changes it to 
the label k. 

Algorithm 3: Expansion- Move 

1. Let a; G Z^, let fc G C The move energy function 
g(2) of binary configuration z G {0,1}^ is defined 
by: 

go = fo, gs{Q) = fs{xs), = fs(k), 

9st{i, 1) = fst{k,k), gst{l,0) fst{k,xt), 
9st{0, 1) = fst{xs, k), gst{0, 0) ^ fst{xs,xt). 

(37) 

2. Let z* G argming(z). 

z 

Xs, if z, = 0, 

3. If g(z*) <g(0), assigns, ^ <^ , ' ' 

y fc, ll Za = 1. 

If the above procedure is repeated for all labels k £ L 
and no improvement to x is found then x is said to be 
a fixed point of this method. 

In the case f is a metric energy [3] , the move energy g 
is submodular for arbitrary x and step 2 is easy. 

Statement 8. Let f be metric Let {x"''"^,L) be 
a strong autarky for f such that .t™'" G {0,L}, Vs G 
V. Then for any fixed point x of the expansion-move 
algorithm there holds 

X > X™. (38) 
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Proof. Assume 3s £ V such that Xg < a;™'". Then 
i{x V X™™) < f (x) and since Xs <E {1, L}, it is 



1, 



L, X™" = L 



(39) 



which is a vahd expansion move from x to label k = L, 
strictly improving the energy. □ 

In the case when a move energy is not submodular, 
it can be "truncated" to make it submodular while still 
preserving the property that the move does not increase 
i{x) [H]. Let Ast = gst{l, 1) + 9st{0, 0) - gst{0, 1) - 
f/st(l,0). Pair st is submodular iff As* < 0. 

Definition 3. Truncation g' of g is different from g 
only in non-submodular pairwisc components of g, 
which are set as: 



g'stflo = 9st,oo — PstAst, 
9st,oi = 9st,m + OLstAst, 

9'st,W = 9stA0 + (1 - Olst - Pst)Ast, 

9'st,ii = 9st,ii, 



(40) 



where ast and /3st are free parameters, satisfying a^t > 
0, /3.t >0, ast+Pst < 1. 

It is easy to verify that g' is submodular, and 

g(z)-g(0) <g'(z)-g'(0), (41) 

saying that increase in g is no more than increase in g' 
when changing from to z. 

Proof of (41). By construction of g', for all si G £ such 
that Ast > 0, enumerating all Zst, 

9'st.oo ~ 9'st.oo ~ 0' 

9'st.oi ^ 9'stfio 9stfli - 9st,m + {ctst + l3st)Ast, 
9'st,w ~ 9'st,m = 9st.w ~ 9st,oo + (1 - a,st)Ast, 
5^4,11 ~ 9'st,oo = 9st,ii ~ 9st.oo + PstAst, 

(42) 

we see that only positive values are added on RHS. 
It is also seen that the added positive values do only 
increase with f3st ■ This means that the truncation with 
Pst > (let's denote it g"-^) is never better than the 
truncation with /3 — (let's denote it g"): Vz 



g(^)-g(0) 



< g"(;^)-g"(0) < g"''^(z)-g"'^(0). (43) 



Similarly, the truncation with a = 0,/3 = 1 {9^'^) is 
not better than the truncation g"''': 



(44) 



0,1/ 



(45) 



g",/^(^)_g-/^(0)<g04(^)_gO,i(o). 

This is verified by examining components: 

^(z,,)-5.V(0)-5S^(^.t)+ 5^/(0) = 

0, Zst = 00, 

A3t(l- (a + /?)), z,t = 01, 

Ast{l-{l-a)), Zst = 10, 

[ A.t(l-/3), Zst = 11, 

> 0. 

If z is an improving move for g"'^ then it is also an 
improving move for any truncation. □ 

We have the following result about Algorithm 2 

Statement 9. Let (cc™™, L) be a strong autarky for 
f obtained by Algorithm 2. Let x be a fixed point of 
the expansion-move algorithm with any truncation rule. 
Then 

X > X™". (46) 

Proof. We will prove that the statement holds for trun- 
cation {a = 0, 13 = 1). We need to show that for a move 
from X to X V x""" the truncated energy decreases at 
least as much as does auxiliary problem built by Alg. 2. 
This can be verified by inspecting pairwise components 
for the 4 cases Zst = 00, 01, 10, 11. □ 

5 Conclusion 

We propose a novel representation of methods [TOl E] 
as deriving domain constraints via LP-autarkies. This 
allows for comparison with other methods deriving do- 
main constraints in the same form [31 |TS] and establish- 
ing relations with common methods of (approximate) 
optimization. We also believe that "label domination" 
condition proposed by [5] can be interpreted in the 
same framework, allowing for the theoretical compari- 
son and or for the design of combined methods. 

Our results open several directions for improve- 
ments. A direct improvement to Alg. 2 can be ob- 
tained as follows. Alg. 2 constructs a multi-label aux- 
iliary problem, which is equivalent to a two-label prob- 
lem (since we know that there is a minimizer with 
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X* G {0,L}, Vs G V). For two label problems, we also 
know that the autarky constructed by roof-dual domi- 
nates the autarky by truncation, so it will be better to 
set 



dst = .mill [.fst{i,j) 



+ mm {bst ~ fstiL,j),Cst - /st(i,i)}] 



(47) 



and solve for roof-dual using reduction to 
MAXFLOW [2]. This would be a non-submodular 
auxiliary problem. 

We can also attempt to construct auxiliary prob- 
lem with mixed submodular and supermodular terms 
as in 115] or design an algorithm which will propose 
an autarky in some greedy way and then verify it via 
solving linear program (24). 
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